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Abstract. We provide criteria for deciding whether a given planar curve is an image of a 
given spatial curve, obtained by a central or a parallel projection with unknown parameters. 
These criteria reduce the projection problem to a certain modification of the equivalence 
problem of planar curves under affine and projective transformations. The latter problem 
can be addressed using Cartan's moving frame method. This leads to a novel algorithmic 
solution of the projection problem for curves. The computational advantage of the algo- 
rithms presented here, in comparison to algorithms based on a straightforward solution, lies 
in a significant reduction of a number of real parameters that has to be eliminated in order 
to establish existence or non-existence of a projection that maps a given spatial curve to 
a given planar curve. The same approach can be used to decide whether a given finite set 
of ordered points on a plane is an image of a given finite set of ordered points in M.^. The 
motivation comes from the problem of establishing a correspondence between an object and 
an image, taken by a camera with unknown position and parameters. 



Keywords: Curve matching, central and parallel projections, finite projective and affine 
cameras, geometric invariants 

1. Introduction 

The problem of identification of objects in 3D with their planar images, taken by a camera 
with unknown position and parameters, is an important task in computer object recognition. 
Since the defining features of many objects can be represented by curves, obtaining an 
algorithmic solution for the projection problem for curves is essential, but appears to be 
unknown in the case of projections with a large number of free parameters. We address this 
problem for two classes of cameras: finite projective cameras and affine cameras. 

The set of finite projective cameras (also called finite cameras) has 11 parameters and 
corresponds to the set of central projections. The set of affine cameras has 8 parameters and 
corresponds to the set of parallel projections. An affine camera can be obtained as a limit of 
a finite camera, as the camera center approaches infinity along the perpendicular from the 



camera center to the image plane. See 17 for an overview of camera projections and related 
geometry. An affine camera has fewer parameters and provides a good approximation of a 
finite camera when the distance between a camera and an object is significantly greater than 
the object depth [T,17 



The projection problem for curves is formulated as follows: 

Problem 1. Given a curve Z in M'^ and a curve X m M^, does there exist a finite camera 
(central projection) or an affine camera (parallel projection) that maps Z to X? 
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A straightforward approach to Problem [T| in the case of central projections, leads to the 
following real quantifier eliminations problem: 

Problem 2. Given a curve Z in and a curve X in decide whether there exist 11 real 
parameters, which describe a central projection P, such that 

\lx & X 3z E Z , such that x = P{z)l 



Real quantifier elimination problems are algorithmically solvable 27 . There is an ex- 
tensive body of literature devoted to computationally effective methods in real quantifier 
elimination, including [s], [14j, [19j, [18j, [25j. High computational complexity of these algo- 
rithms make a reduction in the number of quantifiers to be desirable. 

The projection criteria, developed in this paper, reduces the projection problem to the 
problem of deciding whether the given planar curve X is equivalent to a curve in a certain 
family of planar curves under an action of the projective group, in the case of central projec- 
tions, and under the action of the affine group in the case of parallel projections. The family 
of curves depends on 3 parameters in the case of central projections, and on 2 parameters 
in the case of parallel projections. 

The group-equivalence problem can be solved by an adaptation Cartan's moving frame 
method. Following this method for the case of central projections, when Z and X are 
rational algebraic curves, we define two corresponding rational signature maps Sx'- M — )■ 
and iS^ : — 7- M^. Construction of these signature maps requires only differentiation and 
arithmetic operations and is computationally trivial. Problem [2] reduces to 

Problem 3. Given two rational maps Sx^ M — and iS^: — decide whether there 
exist ci,C2,C3 G M, such that 

Wt G M, where Sxit) is defined, 3s G M, such that Sx(t) = Sz{s, ci, C2, C3). 

Thus, the projection criteria developed in this paper allows us to reduce the number of real 
quantifiers that need to be eliminated from 13 (11 parameters define a central projection, 
one is needed to parametrize curve Z and another one to parametrize curve X) to 5. The 
case of parallel projection is treated in the similar manner and leads to the reduction of the 
number of real quantifiers that need to be eliminated from 10 to 4. 

Previous works on related problems include 11 , where a solution to Problem [l] is given for 



finite cameras with known internal parameters. In this case, the number of free parameters 
is reduced from 11 to 6 parameters, representing the position and the orientation of the 



camera. The method presented in 11 also uses an additional assumption that a planar 
curve X gM.'^ has at least two points, whose tangent lines coincide. In the current paper we 
do not assume that the internal camera parameters are known. 

A solution of the projection problem for finite ordered sets of points under affine cameras 
appeared in 1 2 and served as an inspiration for this paper. In Section [7| we summarize the 
approach of 12 and indicate how the solution of Problem [l] may be adapted to produce an 
alternative solution to the projection problem for finite ordered sets of points under either 
affine or finite cameras. 

One of the advantages of the novel approach to the solution of Problem [T| introduced in 
this paper, is its universality: essentially the same method can be adapted to various types of 
the projections and various types of objects, both continuous and discrete. Similar to many 
previous considerations of the projection problems, we utilize actions of affine and projective 
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groups to obtain a solution to the projection problem. Our literature search did not yield, 
however, neither previous solutions for the projection problem for curves, where cameras 
with unknown internal and external parameters are considered, nor a similar combination of 
ideas as presented here. The algorithmic solution presented here, would have to be fine-tuned 
to become practically useful in real-life applications, but we believe, it has a good potential 
to develop into a practically efficient method. Some directions of such improvement are 
indicated in Section |8] of the paper. 

Problem [T] can be generalized to higher dimensions as follows: 

Problem 4. Given a curve Z in M" and a curve X in M"^^ (n > 3) does there exist a 
central or a parallel projection from W'^'^'^ to a hyperplane in that maps Z to X? 

The solution, proposed in this paper, has a straightforward adaptation to higher dimen- 
sions and will result in a reduction in the number of quantifiers that need to be eliminated 
from n{n + 1) + 1 to n + 2 for central projections and from + 1 to n + 1 for parallel 
projections. In this paper, we restrict the presentation to the case of n = 3, which has 
applications in computer image recognition and presents least computational challenge. 

The paper is structured as follows. After reviewing the geometry of finite and affine 
cameras in Section [2| we define actions of direct products of affine and projective groups 
on the set of cameras in Section [HI We use these actions to reduce Problem [l] for finite 
and affine projections to a modification of the equivalence problem for planar curves under 
projective and affine transformations, respectively. This leads to the main result of this 
paper, projection criteria for curves, formulated in Section |4j In Section [5} we review a 
solution for the group-equivalence problem, based on differential signature construction [6]. 
In Section [6} we combine our projection criteria and the differential signature construction 
in order to obtain an algorithm for solving the projection problem and show some examples. 
Although the projection criteria derived in Section |4] of the paper are valid for arbitrary 
classes of curves (and, more generally, for arbitrary subsets of and M^, respectively) the 
computational algorithms of Section [6] are developed for rational algebraic curves. We will 
consider a possible generalization of these algorithms to non-rational algebraic curves in an 
upcoming paper In Section [T] we indicate how the approach of this paper can be applied 
to the projection problem for finite ordered sets of points. A solution to the latter problem 
for affine projections appeared in (l|[2]. We provide a brief comparison of the two approaches. 
In Section [8| we discuss possible variations of our algorithm based on alternative solutions 
of the group-equivalence problem, as well as possible adaptations to curves presented by 
samples of discrete points whose coordinates may be known only approximately. 

2. Finite and affine cameras 

A simple pinhole camera is shown in Figure [l] and corresponds to a central projection. 
Let {zi,Z2,z^) be coordinates in M^, relative to an orthonormal coordinate basis, such that 
the camera is located at the origin on M.^ and the image plane is passing through the point 
(0, 0, 1) perpendicular to the zs-axis. We assume that a coordinate system on the image 
plane is provided by the first two coordinate functions on M^, i.e. x{zi,Z2,l) = zi and 
y{zi, Z2, 1) = Z2. Then a point {zi, Z2, z^), such that ^3 7^ is projected to the point 




Figure 1. Pinhole camera 29 . 



We introduce a freedom to choose the position of the camera center (3 degrees of freedom), 
the position of the image plane, (3 degrees of freedom), as well as a choice of, in general, non- 
orthogonal, linear system of coordinates on the image plane (5 degrees of freedom, since the 
overall scale is absorbed by the previous choices, i.e., the choice of the distance between the 
image plane and the camera center). For real parameters pij , i = 1 . . . 3, j = 1 . . . 4, a. generic 
projection maps a point {zi, Z2, z^) G to a point in the image plane with coordinates 

Pn Zl + Pl2 Z2 + Pl3 Z3 + Pli 

[Z) X 



y 



P31 Zl + P32 Z2 + P33 ^3 + P34 ' 
P21 Zl + P22 Z2 + P23 Z3 + P24 



P31 Zl + P32 Z2 + P33 Z3 + P34 

A convenient matrix representation of this map is obtained by embedding into projective 
space P" and utilizing homogeneous coordinates on P*^. 

Notation 5. Square brackets around matrices (and, in particular, vectors) will be used to 
denote an equivalence class with respect to multiplication of a matrix by a nonzero scalar. 
Multiplication of equivalence classes of matrices A and B of appropriate sizes is well-defined 
by [A] [B] ■.= [AB]. 

With this notation a point (x, y) G corresponds to a point [x, y, 1] = [Ax, \y, A] G P^ for 
all A 7^ 0, and a point {zi, Z2, z^) G corresponds to [zi, Z2, z^, 1] G P^. We will refer to the 
points in P*^ whose last homogeneous coordinate is zero as points at infinity. In homogeneous 
coordinates projection ^ is given bj|^ 

(3) [x,y,lf = [P][zi,Z2,z,,lf, 

where P is 3 x 4 matrix of rank 3. 

Matrix P has a 1-dimensional kernel, i. e. there exists a non-zero point {z^, z^., z^, z^) G 
such that P 4, 2°, zlf = (0, 0, 0)*''. Therefore, the image of the point [z^, z^, z^, zl\ G P^ 
under the projection is undefined (recall that [0,0,0] is not a point in P^). Geometrically 
the kernel of P corresponds to the center of the projection. 

Camera is called finite if its center is not at infinity. In the case of finite cameras the left 
3x3 submatrix of P is non-singular. 

On the contrary an infinite camera has its center at an infinite point of P^ and so the left 
3x3 submatrix of P is singular. An infinite camera is called affine when the preimage of 
the line at infinity in P^ is the plane at infinity in P^. In this case [P] can be represented by 
a matrix whose last row is (0, 0, 0, 1). Affine cameras correspond to parallel projections from 
to a plane. Eight degrees of freedom reflect a choice of the direction of a projection and 
a choice of, in general non-orthogonal, linear system of coordinates on the image plane. An 



superscript tr denotes transposition. 
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image plane may be assumed to be perpendicular to the direction of the projection, since 
other choices are absorbed in the freedom to choose a coordinate system on the image plane. 

Definition 6. A set of equivalence classes [P], where P = (pij)j=i'"4 is a 3x4 matrix whose 
left 3x3 suhmatrix is non-singular, is called the set of finite projections and is denoted TV . 

A set of equivalence classes \P\, where P = (pij)j=i';;,4 has rank 3 and its last row is 
(0, 0, 0, A), A 7^ 0, is called the set of affine projections and is denoted AV. Affine projections 
are also called generalized weak perspective projections [l][2] j. 

Equation ^ determines a central projection M'^ — i- when [P] G J-^V and it determines 
a parallel projection when [P] G AV. 

The sets of finite and affine projections are disjoint. Projections that are not included 
in these two classes are infinite non-affine projections. These are not frequently used in 
computer vision and are not considered in this paper. 

A simple pinhole camera projection ([!]) is represented by the matrix: 

1 " 
10 

10 

and is called the standard finite projection. The standard affine projection is the orthogonal 
projection on the ziZ2-plane. It is represented by the matrix 

1 " 
10 0. 
1 

3. Group actions 

Since group actions and, in particular, actions of the affine and projective groups play a 
crucial role in our construction, we review here the relevant definitions: 

Definition 7. An action of a group G on a set S is a map $ : G x 5* — t- 5* that satisfies the 
following two properties: 

(1) $(e, s) = s, Vs G S, where e is the identity of the group. 

(2) <l>(^i,$(^2,s)) = <^{gig2,s), W s e S and\fgi,g2 G G. 

For g E G and s G 5 we sometimes write $((7, s) = g s. 

Definition 8. An action is called transitive if for all si,S2 & S there exists g E G such that 
si = gs2. 

Definition 9. For a fixed element s G 5* the set Gg = {g & G\gs = s} G G is called the 
stabilizer of s. 

It can be shown that a stabilizer Gs is a subgroup of G. 

Definition 10. The projective group VQC{n + 1) is a quotient of the general linear group 
QL{n + 1), consisting of (n + 1) x (n + 1) non-singular matrices, by a 1-dimensional abelian 



(4) 



pO ._ 



(5) 



50 ._ 



From now on, we refer to central projections as finite projections and to parallel projections as affine 
projections. 
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subgroup XI , where A 7^ G M and I is the identity matrix. Elements of VQC{n + 1) are 
equivalence classes [B] = [XB], where A 7^ and B G QL{n + 1). 

The affine group A{n) is a subgroup ofVQC{n + 1) whose elements [B] have a represen- 
tative B G QL{n + 1) whose last row is {0, ... , 0, 1). 

The special affine group SA{n) is a subgroup of A{n) whose elements [B] have a repre- 
sentative B G QL{n + 1) with determinant 1 and the last row equal to (0, ... , 0, 1). 

In homogeneous coordinates the standard action of the projective group VQC{n + 1) on 
P" is defined by: 

(6) [^1, . . . , z^, z,]'^) = [B][z,,..., z„, ^o]*-". 

The action ([6]) induces almost everywhere defined linear-fractional action of VQC{n + 1) on 
M". In particular, for = 2, [B] G VQC{3) we have 

/ . _^ / &11 X + 612 y + &13 b2ix + b22y + ^23 ' 

V^31 X + 632 y + 633 ' &31 a; + ^32 y + &33. 

The restriction of ^ to A{n) induces an action on M."' consisting of compositions of linear 
transformations and translations. In particular, for n = 2 and [B] G ^(2) represented by a 
matrix B whose last row is (0, 0, 0, 1) 

(8) (x, y) (611 x + bi2y + 613, &21 a; + 622 y + ^23) • 

3.1. Action on finite cameras. A straightforward exercise in matrix multiplication shows 
that the map $ : iVgC{3) x ^(3)) x J^V ^ J^V defined by 

(9) Hm,m, [p]) = [A][p][B-'] 

for [P] G TV and {[A], [B]) G VQC{3) x ^(3), satisfies Definition |7| of a group-action. 

Proposition 11. The action ofVQC{3) x .4.(3) on TV , defined by is transitive. 

Proof. According to Definition [s] we need to prove that for all [Pi] , [P2] G TV there exists 
{[A], [B]) G VgC{3) X ^(3) such that [A][Pi][5-i] = [P2]- It is sufficient to prove that for all 
[P] G TV there exists {[A], [B]) G VgC{3) x ^(3) such that [P] = [A] [P°] [B], where [P^] is 
the standard finite projection (4]). A finite projection is given by a 3 x 4 matrix P = (pjj)*^^ -'! 
whose left 3x3 submatrix is non-singular. Therefore there exist ci, C2, C3 G M such that 
p*4 = Cip*i -|- C2P*2 + C3p*3, where p^j denotes the j-th column of the matrix P. We define 
A := (Py)}=i;;.3 to be the left 3x3 submatrix of P and 



/ 1 
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C2 
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C3 




^0 
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/ 



(10) B 



We observe that {[A], [B]) G VgC{3) x ^(3) and [A][P^][B] = [P]. □ 

Corollary 12. The set TV of finite projections is diffeomorphic to the homogeneous space 
(VQC{3) X A{3))/H^j, where Hj is the 9-dimensional stabilizer of [Pj]- 

A straightforward computation shows that 

A Q^' 



(11) m = {\ [A] 







where A G QL{3). 



Remark 13. It follows from the proof of Proposition 1J_ that any finite projection is a 
composition of a translation in M.^ (corresponding to translation of the camera center to the 
origin), the standard projection ^ (pinhole camera), and a projective transformation on the 
image plane. 

3.2. Action on affine cameras. Formula g with [P] G AV and {[A], [B]) G ^(2) x ^(3) 
defines an action of the direct product ^(2) x ^(3) on the set of affine projections AV. 

Proposition 14. The action of A(2) x ^(3) on AV, defined by is transitive. 

Proof It is sufficient to prove that for all [P] G AV there exists {[A], [B]) G A{2) x ^(3) 
such that [P] = [A] [P^] [B], where P^ is the standard projection rt5|. An affine projection 
P is given by the matrix 



(12) 



PU Pl2 Pl3 PU 
P = \ P21 P22 P23 P24 

1 



of rank 3. Therefore there exist 1 < i < j < 3 such that the rank of the submatrix 



Pli Plj 

P2i P2j 

such that 



is 2. Then for 1 < A; < 3, such that k i and k ^ j, there exist Ci, C2 G 
+ C2 I "-^ I . We define 



Pik 

P2k 



Cl 



Pli 

P2i 



Plj 

P2j 



(13) 



A :-- 



Pli Plj Pu 

P2i P2j P24 

1 



and define B to be the matrix whose columns are vectors b^:i := (1,0,0, 0)*^, b^j := (0, 1, 0, 0) 



tr 



■'*k 



(Cl,C2,l,0)* 



(0,0, 0,1)*"". We observe that {[A], [B]) G ^(2) x ^(3) and that 



Remark 15. Note that there are only three possible values of {i,j, k) in the above proof: 
if {i, j, k) = (1,2,3), then 



(14) 



B 



/ 1 Cl \ 

1 C2 

10 

\ 1 J 



if {i, j, k) = (1,3,2), then the corresponding B is obtained by interchanging the second 
and the third column in (14); 



if (z, j, k) = (2,3, 1), then the corresponding B is obtained by a cyclic shift (by one to 



the right) of the first three columns in (I4) 



Corollary 16. The set AV of affine projections is diffeomorphic to the homogeneous space 
(^(2) X A{'i))/H^, where is the 10- dimensional stabilizer of [Pa]- 
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A straightforward computation shows that 

/r 



(15) 



\ 



mil ""^12 «i 

m2l 17122 «2 

1 



mil 


mi2 





ai 
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m2i 


m22 





a2 






m32 


"^33 















1 


/ 



where msa (miim22 - mi2m2i) 7^ 0. 

4. Projection criteria for curves 

In this section we formulate criteria for the existence of a finite or an affine projection that 
maps a given algebraic curve in to a given algebraic curve in M?. 

We recall [Ts] that for every algebraic curve X C M" there exists a unique projective 
algebraic curve [X] C P"' such that [X] is the smallest projective variety containing X . As 
before, we identify a point on [X] with the column vector of its homogeneous coordinates. 

Definition 17. We say that a curve Z dM? projects onto X (ZM? if there exists a 3 x 4 
matrix P of rank 3 such that the set [P] [Z] is dense in [X] . In this definition, we allow the 
center of the projection [P] to lie on [Z], and if this happens [P][Z] is undefined at one point. 

Note that if 2 C M'^ projects onto X gM."^ according to Definition [Tt] then the image of Z 
under the map ^ is dense in X. Disregarding possible exclusions of finites sets of points, 
we write X = [P]{Z) and [X] = [P][Z] if Definition 17 is satisfied. 

In the next two subsections we show that the projection problem for central and parallel 
projections can be reduced to a variation of the equivalence problem of planar curves under 
projective and affine actions, respectively. 

Definition 18. We say that two curves Xi C M" and X2 C M" are VQC{n + l)-equivalent 
(and also that [Xi], [X2] G P" are VQC{n + 1) -equivalent) if there exists [A\ G VQC{n + 1), 
such that 



(16) 



[X2] = {[A][x]\[x]e[X,]}. 



If (16) is satisfied for [A] G G, where G is a subgroup ofVQC{n + 1), we say that Xi and 
X2 are G- equivalent. 



We write X2 = [A\[Xi) and [X2] = [A\[X^ if Definition 18 is satisfied. Before stating the 
projection criteria, we make the following simple, but important observation. 

Proposition 19. (i) If Z dM? projects onto X hy an affine projection, then any 

curve that is A{3)- equivalent to Z projects onto any curve that is A{2)- equivalent to 
X by an affine projection. In other words, affine projections are defined on affine 
equivalence classes of curves. 
(ii) If Z (ZM.^ projects onto X G M."^ by a finite projection then any curve in M.^ that is 
Ai?))- equivalent to Z projects onto any curve on that is VQ C{3) -equivalent to X 
by a finite projection. 

Proof, (i) Assume that there exists an affine projection [P] G AV such that [X] = [P][Z]. 
Then for all {A, B) G ^(2)x^(3) we have [A] [X] = [A] [P] [p-^] {[B] [Z]). Since [A] [P] [p-^] 
AV, a set projects onto [A] [A*], (ii) is proved similarly. □ 

8 



It is not true in general that if a curve Z can be projected onto two planar curves Xi 
and X2 by an affine (or a finite) projection, then the curves Xi and X2 are ^(2)-equivalent 
(or P^£(3)-equivalent). Counterexamples appear in Example 31 (for finite projections) and 
Example 34 (for affine projections). 

We are now ready to state and prove the projection criteria. 

Theorem 20. ^finite projection criteria^ A curve Z C M.^ projects onto a curve 
A" C by a finite projection if and only if there exist Ci, C2, C3 G M such that the projective 
curve 



(17) 



Cl,C2,C3j 



[Zi + Ci, Z2 + 02, Z3 + C3] V(Zi, Z2, Z3) E Z,\ CF' 



IS VgC{3)- equivalent to [X] C 

Proof. (^) Assume there exists a finite projection [P] such that [X] = [P] [Z]. It was es- 
tablished in the proof of Proposition 11 that [P] = [A] [Pj?] [B] for some [A] G VQC{3) and 
[B] G SA{3), where B is given by (10) for some Ci, 02,03 G M, and Pj is the standard finite 
projection (0). Therefore [X] = [A] 



P^] [B] [Z]. Since 

[P?][fi][2;i, Z2, Zs, If = [Zi + Ci, Z2 + 02, Z^ + C3]* 



then [X] = [A][Zc,^c2,c3], where [Z^, 

,02,03] is defined by ( |17[ ) 
(<^=) To prove the converse direction we assume that there exists [A] G VQC{3) and 
Ci,C2,C3 G M such that [X] = [A][Zc-^^c2,c3], where [^ci,c2,c3] is defined by (17). A direct 



computation shows that Z is projected onto X by the finite projection [P] = [A] [P^] [B] 



where B is given by (10) and [Pj] is the standard finite projection (|4|). 



□ 



Theorem 21. fAFFINE projection criteria.) a curve Z C projects onto a curve 
X G M."^ by an affine projection if and only if there exist Ci,C2 G M and an ordered triplet 
{i,j, k) G {(1, 2, 3), (1, 3, 2), (2, 3, 1)} such that the planar curve 



(1^ 



jri,j,k 

Cl,C2 



{Zi + Ci Zk, Zj + 02 Zk) (^1, Z2, Z^) e Z \ d 



is A{2)- equivalent to X G M."^ . 

Proof. (^)Assume Z projects onto X. Then there exists an affine projection [P] G AV 
such that [X] = [P][Z]. Recall that the matrix P is of the form (12) and let {i,j,k) be a 
permutation of numbers (1, 2, 3) such that i < j and the submatrix of P formed by the i-th 
and j-th columns has rank 2. As it was established in the proof of Proposition [M] there exist 
[A] G ^(2) and [B] G A(3), listed in Remark (Ts) such that [P] = [A] [P°] [B], where [P°] is 
the standard projection fc. Since [P°][P][Z] = [^^f'^^J, then [X] = [A][Z^f';fJ and the direct 
statement is proved. 

(<^=) To prove the converse direction we assume that there exist [A] G ^(2), two real 
numbers Ci and 02, and a triplet of indices such that (i, j, k) G {(1,2,3), (1,3,2), (2,3, 1)}, 



such that [X] = [A][Zl'_^'l:J, where a planar curve Zl'^'^^{s) is given by (18). Let P be a matrix 
listed in Remark [Tsj corresponding to the (i, j, fc)-triplet. A direct computation shows that 
Z is projected onto X by the affine projection [P] = [y4][P°][P]. □ 

The families of set Z^'^'^ given by (18) with 



{t,j,k) G {(1,2,3), (1,3,2), (2,3,1)} and 
ci,C2 G M have a large overlap. The following corollary eliminates this redundancy and, 
therefore, is useful for practical computations. 
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Corollary 22. ^reduced affine projection criteria) A curve Z cM.^ projects onto 
X G M."^ by an affine (parallel) projection if and only if there exist b,c, f G M. such that the 
curve X is A{2)- equivalent to one of the following planar curves 



(19) 
(20) 
(21) 



Z 



(^2, Zs) {Zi,Z2,Z3) e Z \ C 



2b = |(zi + 62:2, ^s) {zi, Z2, Z3) e Z^ c 



z, 



c,f\ 



>1 + CZ3, Z2 + f Z^) 



[zi,z2,z3) e z \ c 



Proof. We first prove that for any permutation {i,j,k) of numbers (1,2,3) such that i < j, 
and for any ci, C2 G M the set ^cf/ct = + Ci Zk, zj + C2 Zk) {zi, Z2, Z3) e Z \ is ^(2)- 



equivalent to one of the sets listed in (19)-(21) 

Zcj with c 



'1,2,3 

,C2 



Obviously, Zl^'' 
For Z^f^l, if C2 ^ then 



C2 



ci and / = 02- 

Zl + C1Z2 
Z-i + C2Z2 

Otherwise, if C2 



1 

^ 

- and / 



-1 - 

^2 + ^.z:, 



and so Zli^^ is 

t-1 ,(-2 



C2 ' 



'1,3.2 



0, the 



^(2)-equivalent to Zcj with c : 
6 = Ci. _ 

Similarly for 2'^;^^^, if C2 7^ then Z'^f'j^^ is ^(2)-equivalent to Z^ f with c 



Zh with 



/ = -|. Otherwise, if C2 = 0, then Zlf^i^{s) = {z2{s) + ciZi{s), z^is)). If ci ^ then Z, 

1 ^i-U^^,.rir,„ ^ _ g QJH(^ Z^'^1^ = Z. 



Cl 



and 

2,3,1 

Cl,C2 



Cl,C2 



is .4(2)-equivalent to Zi, with b 

We can reverse the argument and show that any curve given by ( 19 )-(21 ) is ^(2)-equivalent 
to a curve from family (18). Then the reduced criteria follows from Theorem |2Tj □ 



5. Group-equivalence problem 



Theorems [20] and [21] reduce the projection problem to the problem of establishing group- 
action equivalence between a given curve and a curve from a certain family. A variety of 
methods exist to solve group-equivalence problem for curves. We base our algorithm on the 
differential signature construction described in |6j which originates from Cartan's moving 
frame method 0. We consider the possibility of using some other methods in Section [s] 

5.1. Differential invariants for planar curves. In this section we consider rational alge- 



braic curves, i. e. curves 7(t) = {x{t),y{t)) defined by a rational map 7: 



— > 



% defined on 



M, with a possible exclusion of a finite set of points, where the denominators of x{t) or y{t) 
are zeroj^ By we denote the image of 7 in M^. The case of non-rational algebraic curves 
will be considered in f4|. 

An action of a group G on induces an action on curves in M^. Using the chain rule, 
this action can be prolonged to the k-th order jet space of curves denoted by J'''. Variables 
x,y,x,y,x,y, . . . , which represent the derivatives of x,y with respect to the parameter of 
orders from to k, serve as coordinate functions on J'''. 



Definition 23. Restriction of a function J-" on to a curve ^it) = {x{t),y{t)), t G 
a single-variable function J^l-yit) := J-" (^x(t),y(t), ^^2^ , . . . 



zs 



Throughout the paper, when we make a statement about a rational map, we assume, without saying so, 
that the statement holds on the domain of the definition of the map. 
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A function J-" on is invariant under reparameterizations if for all rational curves 
7: M — i- ]R2 and for all rational maps 0: M — )■ M, we have J-'|^(0(t)) = J^\^{t), where 7(t) = 

im))- 

For example, x\!y{t) = x\^{(j){t))(j)'{t), and hence x is not invariant under reparameteriza- 
tions, but I is invariant under reparameterizations. 

Definition 24. A k-th order differential invariant is a function on that depends on k-th 
order jet variables and is invariant under the prolonged action of G and reparameterizations 
of curves. 

For example, for the action of the 3-dimensional Euclidean group, consisting of rotations, 
translations and reflections on the plane, the curvature k = ^^~^y is (up to a sign) a lowest 

order differential invariant. The sign of k, changes when a curve is reflected, rotated by vr 
radians or traced in the opposite direction (k^ is invariant under the full Euclidean group). 
Higher order differential invariants are obtained by differentiation of curvature with respect 
to Euclidean arclength ds = a/x^ + dt, i. e. Kg = = i\ .J ji- Any other Euclidean 

differential invariant can be locally expressed as a function of 

For the majority of Lie group actions on M^, a lowest order differential invariant appears 
at order r — 1 where r = dim G. The group actions on the plane with this property are called 
ordinary. All actions considered in this paper are ordinary. A lowest order differential invari- 
ant for an ordinary action of a group G is called G-curvature, and a lowest order invariant 
differential form is called infinitesimal G-arclength. Any differential invariant with respect 
to the G-action can be locally expressed as a functions of G-curvature and its derivatives 
with respect to G-arclength. Affine and projective curvatures and infinitesimal arclengths 



are well known, and can be expressed in terms of Euclidean invariants 10 ,21 



In particular, iS^-curvature /i and infinitesimal iS^-arclength da are expressed in terms 
of their Euclidean counterparts as follows: 

(22) ^^ 3KiKs, + 3j'J-5Kl ^ da = K^'Hs. 

iS^(2)-curvature has the differential order 4. Any iS^-differential invariant can be locally 
expressed as a function of /i and its derivatives with respect to the iS^-arclength: /!„ = 
/^oa = • • • • 5^-curvature is undefined for straight lines (k = 0) and ^ is undefined 
at the inflection points of a curve. It is shown, for instance, in [15] that is constant if 
and only if is a conic. Moreover, /i|-y = if and only if Gy is a parabola, is a positive 
constant if and only if G^ is an ellipse, and yu|^ is a negative constant if and only if G^ is a 
hyperbola. 

By considering the effects of scalings and reflections on i5^(2)-invariants, we obtain two 
lowest order ^(2)-invariants that are rational functions in jet variables: 

/r)o\ 7 _ (/^q) TV- _ /^"Q 

I2dj Ja- ^3 , 

P^£(3)-curvature rj and infinitesimal arclength dp are expressed in terms of their SA- 
counterparts: 

(24) ^^ Q^^a^a^^a-^pl^-%l^^ ^ dp = fil!'da. 
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The two lowest order rational P^£(3)-invariants 

(25) Jp = r/^ Kp = 7]p. 

are of differential order 7 and 8, respectively. 



Definition 25. A curve 7 is called ^(2)-exceptional if invariants (23) are undefined on a 
one- dimensional subset of C^. Equivalently is a straight line or a parabola. In the former 
case its Euclidean curvature = 0, while in the latter case its SA-curvature = 0. 



A curves is ca//e(i P^£(3)-exceptional if invariants (25) are undefined on a one- dimensional 



subset ofCy. Equivalently, is a straight line or a conic. In the latter case is a constant. 

5.2. Differential signature for planar curves. Following [6j we will use differential sig- 
natures to solve the equivalence problem for curves under a group action. 

Definition 26. Let Jg and Kg be differential invariants of orders r — 1 and r, respectively, 
for an ordinary action of an r -dimensional Lie group G on the plane. A G-signature of a 
non- exceptional parametric curve 7(t) = {x{t),y{t)) , t & M., is a parametric curve S^{t) = 

{jGU{t),KGU{t)). 

We note that a signature S"^ : M — t- of a rational curve 7(t), which is defined using 



rational G-invariants, such as given by (23) or (25), is again a rational curve M — t- M . In a 



d2. 



degenerate case the image of consists of a single point in 

3(j, k) G M^ such that JGl-yit) = j, KG\^it) = k, Vt G M. 

Curves with degenerate signatures are symmetric with respect to a one-dimesional subgroup 
of G. For example, circles and lines have constant Euclidean signatures. A circle is symmetric 
under rotations about its center and a line is symmetric under translations along itself. 

It follows from the definition of invariants that the image &^ := {S.y{t)\t G M} is invariant 
under reparametrizations of the curve 7 and that the following theorem holds: 

Theorem 27. // two non G-exceptional planar rational curves Ga and Gp are G-equivalent 
then the images of their G -signatures coincide: = 



Theorem 27 is valid not only for rational curves, but for all classes of curves to which 
the definition of signature can be reasonably adapted, and, in particular, for curves with 
arbitrary smooth parameterizations. Examples in j22] suggest that one has to be careful 
when stating the converse of this theorem for arbitrary smooth curves. Theorem 8.53 of p4] 
shows that the converse is true for curves y = f{x) where / : M — !■ M is an analytic function. 
In |4] we show that this proof can be adapted to the case of rational algebraic curves and 
obtain the following result: 

Theorem 28. Two non G-exceptional planar rational curves Ga and Gp are G-equivalent if 
and only if their G-signatures coincide: = &p. 

A G-exceptional curve is not G-equivalent to any of non G-exceptional curves. 

Remark 29. Signature construction reduces the problem of G-equivalence of rational al- 
gebraic curves to the problem of deciding whether two rational maps from M to (that 
represent the signatures of the given curves) have the same images. The implicit equation 
S^{K, J) = for the signature curve can be computed by an elimination algorithm as out- 
lined, for instance, in Section 3.3 of |9|. When comparing signatures using their implicit 
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equations, one has to be aware that, since M is not an algebraically closed field, two non 
overlapping signature curves can have the same implicit equation as shown by Example 8. 69 
m [24J. 



6. Algorithms and Examples 

In this section, we outline the algorithms for solving projection problems based on a 
combination of the projection criteria of Section |4] and the group equivalence criterion of 
Section |5] The detailed algorithms, which also cover G-exceptional curves, and their pre- 
liminary Maple implementation are posted on www.math.ncsu.edu/~iakogan/symbolic7l 
[projections.html. We illustrate the algorithms by several examples. Additional examples 
can be found at the above link. 



6.1. Finite projections. The following algorithm is based on the finite projection criteria 
stated in Theorem | 



Algorithm 30. (Outline for finite projections.) 

INPUT: a planar curve ■y(t) = (x(t), y{t)), t G M, and a spatial curve T{t) = (^zi{s) , Z2{s) , -23(5)) , 
s G M, with rational parameterizations. 

OUTPUT: YES or NO answer to the question "Does there exist a finite projection [P], such 
that [C^] = [P][Cr] IS satisfied?". 

STEPS: 

(1) 2/7 is VQ C{3) - exceptional (a straight line or a conic) then follow a special procedure, 
else 

(2) evaluate VQC{3) -invariants given by (25) on 7(t). The result consists of two rational 
functions Jp\-y(t) and Kp\^(t) oft; 

(3) for arbitrary Ci, 02,03 G M define a curve €^,,02,03(3) = 2(^)5); 

(4) evaluate VQ C{3) -invariants given by (25) on eci,c2,c3('5) - obtain two rational functions 
-'pUci,C2,C3,s) and Kp\^{ci,C2,C'i,s) of 01,02,03 and s; 

(5) if 3oi, 02,03 G M, such that Wt G M, where denominators of Jp\^(t) and Kp\^(t) are 
non- zero, 3s G M.' 

Jp\e{ci, 02,03, s) = Jp\-y{t) and Kp\^{oi, 02,03, s) = Kp\^{t), 

then OUTPUT: YES, else OUTPUT: NO. 

If the output is YES then, in many cases, we can, in addition to establishing the existence 
of 01,02,03 in Step 8 of the algorithm, find at least one of such triplets explicitly. We then 
know that Cr can be projected to by a projection centered at (— ci, —02, —03). 

We can also, in many cases, determine explicitly a transformation [A] G VQC{3) that 
maps C-y to Ce^^ . We then know that Cr can be projected to by the projection 
[P] = [A][P^][Bl where P^ is defined by Q and B is defined by (|lO|. 

Example 31. We would like to decide if the spatial curve 

(26) r(s) = {zi{s), Z2{s), Z3{s)) = (s^ s^ s) , s G M 
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projects onto any of three given planar curves for t G 

71 W = {t\t), 

72 (t) = 

73 (t) = 

For ci,C2,C3 we define a curve 
(27) 



t + i 



S-^ + Ci S'^ + 02 



S + C3 S + Cs 



Since parabola 7i(t) is VQ £.{?))-exceptional, its VQC{3)- signature is undefined. It is known 
that all planar conies are VQC{3)- equivalent and so, from Theorem 20, we know that Cr can 
he projected to if there exist Ci, C2, C3 G M, such that the curve defined by (21) is a conic. 
This is obviously true for Ci = C2 = C3 = 0. Indeed, on can check that Cr can be projected to 
C-y^ by the standard finite projection 

The curve 72(i) is not VQ C{3)-exceptional, but has a degenerate signature: 



•^pl72(^) — 



250047 
12800 



and Jplyii't) = 0, Vt G 



Following Algorithm \3(^ we need to decide whether there exist Ci, 02,03 G 

same 

and C3 = 1. We can 



such that the 

restriction of invariants (25) to the curve defined by (21) have the same values Jp\e{s) = 
250047 and J„ 



0, Vs G 



12800 '^p\<^y-^J — w, vo ^ jiv.. This is, indeed, true for c\ = 02 
check that Cr can be projected to C^^ by the a finite projection 



P :-- 



10 
10 
11 



It is important to observe that, although Cr can be projected to both C^^ and C^^, the 
last two curves are not P^£(3)-equivalent. This underscores an observation made after 
Proposition [T9| 

The curve 73 (t) also has a degenerate signature: 



1029 
128 



and Jpl-y^it) = 0. 



Following Algorithm [30l we need to decide whether there exist Ci, 02,03 G 



such that re- 
striction of invariants (25) to the curve defined by (27) have the same values Jp|e(s) = 
0, Vs G M. Substitution of several values of s, yields a system of polyno- 



^ and Jp\,{s) = 0, Vs G 
mial equations for Ci, 02,03 G 
projection from Cr to C^^. 



that has no solutions. We conclude that there is no finite 



6.2. AfRne projections. The following algorithm is based on the reduced affine projection 



criteria stated in Corollary 22 



Algorithm 32. (Outline for affine projections.) 

INPUT: a planar curve 7(t) = (a;(t), y{t)), t G M, and a spatial curve T{t) = {zi{s), Z2{s), 2:3(5)) , 
s G M, with rational parameterizations. 
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OUTPUT: YES or NO answer to the question "Does there exist an affine projection [P], 
such that [C^] = [-P][Cr] is satisfied?". 

STEPS: 

(1) 2/7 is A{2)- exceptional (a straight line or a parabola) then follow a special procedure, 
else 

(2) evaluate A{2) -invariants given by (23) on 7(t). The result consists of two rational 
functions Ja\-yit) and Ka\-y(t) oft; 

(3) define a curve a{s) = {z2{s) , Z2,{s)) ; 

(4) evaluate A{2) -invariants given by on a{s) - obtain two rational functions Ja|Q!('S) 
and Ka\a{s) of s; 

(5) ifWt G M, where denominators of Ja\-^/it) and Ka\-y{t) are non-zero, 3s G M; 

■Ja\a{s) = JaUit) and Kalais) = Ka\^it), 

then OUTPUT: YES and exit the procedure, else 

(6) for arbitrary 6 G M define a curve f3h{s) = (^i(s) + bz2{s), -23(5)); 

(7) evaluate A{2) -invariants given by (23) on f3b{s) - obtain two rational functions Ja\i3{b, s) 
and Ka\i3{b, s) of b and s; 

(8) if 3 6 G M, such that^t G M, where denominators of Jal^yit) and Ka\^{t) are non-zero, 
3s G M; 

Jalfsib, S) = Jalyit) and Ka\i3{b, S) = Kal^it), 

then OUTPUT: YES and exit the procedure, else 

(9) for arbitrary c, / G M define a curve 5c,/(s) = (-2i(s) + cz3{s), Z2 + f z^i^s)); 

(10) evaluate A{2) -invariants given by (23) on Scj{s) - obtain two rational functions 
Ja\s{cJ,s) and Kalsic, f,s) of cj and s; 

(11) z/ 3 c, / G M , such that Vt G M, where denominators of Ja\'y{t) and Ka\'y{t) are 
non-zero, 3s G M; 

Ja\&{c, f, S) = Jalyit) and Kalsic, f, s) = Ka\y{t), 

then OUTPUT: YES else OUTPUT: NO. 

Although the algorithm for affine projections includes more steps then its finite projection 
counterpart, it is computationally less challenging. If the output is YES then, in many cases, 
we can find an affine projection explicitly. 

Example 33. In order to decide whether the spatial curve 

r(s) = (^i(s), Z2{s), z^is)) = (s^ + 1, s^, s) , s G M, 

can be projected onto 7(t) = {t , t^ + 1'^) , t E M. by an affine projection, we start by deter- 
mining that 7 is not an A{2)- exceptional curve (neither a straight line or a parabola). The 
curve 7 has non-constant A{2) -invariants (2^ that satisfy the following implicit signature 
equation: 

(28) - 448 J2 + (3780 K + 14525) J + 245 + 40000 - 6000 K - 1575 = 

Following Algorithm\3^ we first check whether '^{t) is A{2)- equivalent to a{s) = {z2{s), zs{s)) = 
(s^, s). The answer is no, since a{s) is an A{2)- exceptional curve (parabola) and 7(t) is not 
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A{2)- exceptional. We next check whether there exists 6 G M such that 7(t) is A{2)- equivalent 
to j3b{s) = [ zi{s) + b Z2{s) , zs{s)) = [s'^ + l + bs'^, s) . We evaluate invariants on (5h{s): 

(29) Ja\,As) = ^^_us^y > 

-5(140.^-56&.^ + &^) 

(30) i^a|,.(.) = 14 ,2)2 • 

VF/ien 6 = t/ie invariants are constant: Ja\/3ois) = —50/7 and ^^[^^(s) = —25/7, and, 



therefore, /3o{s) is not A{2)- equivalent to 7(t). For all b ^ the invariants \29^ and (30) 
are non-constant and satisfy the signature equation (28). 

This provides a necessary condition and a strong indication that 7(t) is A{2)- equivalent 
to (3b{s) for b ^ 0. For 6=1 this A{2) -equivalence is obvious, and hence T{s) projects onto 
7(t) by an affine projection. 

Example 34. We would like to decide if the spatial curve 

(31) r(s) = (zi(s), Z2{s), zsis)) = {s^ + s,s'-3 s\ s^),seR 
projects onto any of three given planar curves for t G M/ 

71 (t) = {t' + t,t'), 

l2{t) = (t=^ - t , + t') , 

73(t) = (t/(l + t^)^ t^/{l + t^)) (FoUum of Descartes). 

None of given 7 's is A{2)- exceptional and the implicit equations of their A{2) -signatures are 
given, respectively, by: 

(32) 5^^: (165 + 75K)J-448 - 560/C-175ir2 = 0, 

(33) : 9261 - (26460 K + 132300) J + 160 + 160000 + 264000 K + 12900 K"^ = 0, 

(34) 5^3: 10Er + l = 0. 



Following Algorithm 32, we establish that a{s) = [z2{s), z^^s)) and f3b{s) = {zi{s) + 
6^2(5), ^3(5)), for all 6 G M, are not A{2) -equivalent to either of •y's. 

We then establish that 6cj{s) = {zi{s) + 0^3(5), Z2{s) + f z^i^s)) is A{2)- equivalent to 71 
when c = and / = 1/2 and is A{2)- equivalent to 72 when c = and / = 0, but there are 
no real values of f and c such that Scj{s) and 73 are A{2)- equivalent. 

We conclude that there are affine projections o/r(s) onto both 71 (t) and 72(^)7 but not 
onto 73 (t). 

We note that, although T{s) affinely projects to both 71 (t) and 72 (t), the curves 71 (t) and 
72 (t) are not A{2) -equivalent because their signatures have different implicit equations (32) 
and (33). This illustrates that the converse to Proposition 19 does not hold. 



7. Projection of finite ordered sets (lists) of points 

In [l]|2], the authors present a solution to the problem of deciding whether or not there ex- 
ists an affine projection of a list Z = (z^, . . . , z™) of m points in M? to a list X = (x^, . . . , x"^) 
of m points in M^, without finding a projection explicitly. They identify the lists Z and X 
with the elements of certain Grassmanian spaces and use Pliiker embedding of Grassmanians 
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into projective spaces to explicitly define the algebraic variety that characterizes pairs of sets 
related by an affine projection. 

We indicate here how our approach leads to an alternative solution for the projection 
problem for lists of points. Details of this adaptation appear in the dissertation [s] and in 
an upcoming paper |4]. 

Theorem 35. (finite projection criteria for lists of points.) A given list Z = 
(z""^, . . . , z™) of m points in M.^ with coordinates z* = {z[, Z2, z^) , r = l...m projects onto 
a given list X = (x^, . . . ,x™) of m points in with coordinates = {x^,y^) by a finite 
projection if and only if there exist ci, C2, C3 G M and [A] G VQC{3), such that 

(35) [x^ 1]*'^ = [A][zl + ci, z^, + C2, z; + c,f^ forr = l...m. 

Theorem 36. (affine projection criteria for lists of points.) A given list Z = 
{z^, . . . , z™) of m points in with coordinates z* = {z[, Z2, z^), r = 1 . . . m projects onto a 
given list X = (x^, . . . , x™) ofm points in with coordinates x** = {x^ , y^) by an affine pro- 
jection if and only if there exist ci, C2 G M, an ordered triplet {i,j, k) G {(1, 2, 3), (1, 3, 2), (2, 3, 1)} 
and [A\ G ^(2), such that 

(36) [x^ y^ 1]*^ = [A] [zl + ci 4, + C2 4, if forT = l...m. 

The proofs of Theorems |35] and |36] are straightforward adaptations of the proofs of The- 

is 



orem 



20 and 21 The reduced affine projection criteria for curves, given in Corollary 22 
adapted to the finite lists in an analogous way. 

The finite and the affine projection problems for lists of m points are, therefore, reduced 
to a modification of the problems of equivalence of two lists of m points in under the 
action of VQCi^) and ^(2) groups, respectively. A separating set of invariants for lists of m 
points in under .4(2)-action consists of ratios of certain areas and is listed, for instance, 
in Theorem 3.5 of [23]. Similarly, a separating set of invariants for lists of m ordered points 
in P^ under P^£(3)-action consists of cross-ratios of certain areas and is listed, for instance, 
in Theorem 3.10 in [23]. In the case of finite projections, we, thus, obtain a system of 
polynomial equations on ci , C2 and C3 that have solutions if and only if the given set Z 



projects to the given set X. An analogue of Algorithm [30] for finite lists of points follows. 
The affine projections are treated in a similar way. 

Figure |2] illustrates that a solution of the projection problem for lists of points does not 
provide an immediate solution to the discretization of the projection problem for curves. 
Indeed, if Z = (z^, . . . , z™) is a discrete sampling of a curve F and X = (x^, . . . ,x'") is 
a discrete sampling of 7, these lists might not be in a correspondence under a projection 
even when the curves are related by a projection. Some approaches to discretization of the 
projection algorithms for curves are discussed in the next section. 



8. Directions of further research 

The projection criteria developed in Section |4] reduce the problem of object-image corre- 
spondence for curves under a projection from M.^ to M^, to a variation of the group-equivalence 
problem for curves in M^. We use differential signature construction [6j to address the group- 
equivalence problem. In practical applications, curves are often presented by samples of 
points. In this case, invariant numerical approximations of differential invariants presented 
in [3||6] may be used to obtain signatures. Differential invariants and their approximations 
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Figure 2. Projection problem for curves vs. projection problems for finite 
ordered sets of points 



are highly sensitive to image perturbations and, therefore, are not practical in many situa- 



tions. Other types of invariants, such as semi- differential (or joint) invariants 23 ,28 , integral 
invariants 12,16,26 and moment invariants pO] are less sensitive to image perturbations 



and may be employed to solve the group-equivalence problem. One of our future projects is 



to develop variations of Algorithms 30 and 32 that are based on alternative solutions of the 
group-equivalence problem. 

One of the essential contributions of (l||2] is the definition of an object/image distance 
between ordered sets of m points in and M^, such that the distance is zero if and only if 
these sets are related by a projection. Since, in practice, we are given only an approximate 
position of points, a "good" object/image distance provides a tool for deciding whether a 
given set of points in is a good approximation of a projection of a given set of points in 
M^. Defining such object/image distance in the case of curves is an important direction of 
further research. 

Although the projection algorithm presented here may not be immediatly applicable to 
real-life images, we consider this work to be a first step toward the development of more 
efficient algorithms to determine projection correspondence for curves and other continuous 
objects - the problem whose algorithmic solution, for classes of projections with large degrees 
of freedom, does not seem to appear in the literature. 

Acknowledgements: This project was inspired by a discussion with Peter Stiller of paper 
[2] during IS&T/ SPIE 2007 symposium. We also thank Hoon Hong and Peter Olver for 
discussions of this project. 
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